Information Tool ReviewsOpen source LLM-powered literature search system by Ai2, built on Semantic Scholar, excelling in transparency.
RECOMMENDED Framework Verdict
Framework VerdictData privacy policy
AI model training policy
Intellectual property preservation
Accessibility
TR Transparency ●●●3/3 | RE Reliability ●●○2.5/3 | US Usability ●●○2.5/3 | SE Soundness ●●○2/3 | TC Traceability ●●●3/3 | Overall ●●○2.6/3 |
|---|
Conclusion
An open-sourced and well documented tool that shows how it works and what it does in a transparant manner. The results are often quite good, and always come with reasoning/evidence. The fact that the tool verbosely interprets your request and breaks it down into specific requirements for inclusion is very helpful even without any results as a help to fine-tune (re)search questions.
Recommendation
This feels like a nice tool for multiple use cases, as the transparacy in the process makes it suitable for e.g. learning how LLM's interpret your prompts and decide relevancy. It is also relatively simple and open source, so it can make a fine base for a more complex tooling.
Strengths
- Transparent LLM usage
- Clearly supported results
- Open source and free
- Natural language interaction works well
Weaknesses
- Only semantic scholar as a backend
- Limited filtering / metadata available in this interface
- No direct connections with other tools like Zotero
- Cannot use existing papers as input
- No way to do combine natural language queries with manual/deterministic additions
- Base privacy/content policy does not match our requirements, need to self-host to circumvent
